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Progranminq Errors in apL 
Greg P. KearsXey 
Division ox Educational Research Services * 
University of Alberti^ 

In recent years there has l>een considerable interest in 
the study of computer progio^siacj by cognitive 
psychologists r conputer scientists, and human factors 
rs^reci-aiistsy* J^sychologists Tiave beeti interested in 
prpgraaaingi as a complex problem -solving tasJc >»hich reveals 
impprtant aspects of human information processing capability 
(i:.ither in individuals or groups) . Computer scientists have 
luaiiily focused on those aspects which pertain to language 
detiign and implementation'* Human factor specialists have 
been concerned with improvin^^ the productxv^ity^and^ quality 
or programming activity (e.g'l^ training, error reduction). 
?hile each group of scientists has a somewhat different 

perspective due to their particular orientation, there has 

J 

been considerable interaction as research interests 
transgress traditional disciplinary bounaaries. 

./ 

I'jie study oi protjraBudng errors is aa exdaple ol a 
topic witliin this research area wbich has interested 
cognitive psychologists, computer scientists and hunan 
factor specialists. As a conse<juence, a nunber of differen.t 
approaches have Jt»een employed. BroHn & Sampson (1973) 
suggest soiie techniques for aToiding or reduce prograMiting 



1, Tj*o pioneering worxs in this a tea were SacJcaan (1970) and 
wienbery (1971) . 
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.errors on the basis of experience in business;* lounqs (1974) 
collected various types of protocol data £ro« a group of 
novice and experienced prograamers on assigned tasks in 
ALGOL, liASIC, COBOL, FOKTRAN and PL/1* k comparison of the 
relative -importance of different types of errors for the 
different languages and in terns of prograaning experience 
vas made. Miller (1974) used an experimental language and 
non-programmers to test the relative difficulty of certain 
control structures (conjunctive vs. disjunctive, affirmative 
rs\ negative tests) • Gould (1975) studied the debugging 
processes of experienced FORTH AN programmers and compared 
the debug times and errors missed for different types of 
errors* Hayer (1975) studied the effects of using diagrammic 
models during the teaching of a simplfled version of 
FORTRAN* 

These studies are re'^:resentative of the current 
approaches to the study of programming errors in coding and 
debugging* A nuBiber of major variables have been identified; 
the tvo most important being programming experience and the 
nature of the task or problem* Different types and patterns 
of errors arise from inexperienced and experienced 
programmers, and also from difrferent application or problem 
domains* other variables such as time-sharing versus batch 
programmincj, use of programming aids, or use of CRT versus 
hardcopy are also known to affect the nature of programming 
errors* Some attempts have been made to formulate theories 
of programming (e*g*, Gould, 1975; Shneiderman, 1977) and to 
relate the study of programming behavior to general 



psychological research (e«9., Cooke & Bunt, 1975) • 

While iiany languages (bot.h real and experimental) have 
been studied^ errors in hBL prograsming apparently^ have not 
received attention* Xhis is sonewhat saprising since APL is 
cosponly considered one of the aost .poverful oL the 
presently existing high level iangauges* Certainly^ it is 
one of the mostly widely used langauges today « Furthermore, 
A Pkj.ej2r.0rs; .should^ be particularly^ interesting because of the 
canonical nature of the error me£fsage types. Saal fc tfeiss 
(1977) provide a comprehensive and interesting study of APL 
usage; however, they did hot report error data in this 
study • The present paper p^rovidfes a discussion and some 
preliminary data on errors in APL programming • 

• £rror types in hBL 

Youngs (1974) classified programming errors into 4 
broad categories: 

(a) syntax errors which result from expressions vhich are 
incorrect regardless of the context in which they 
appear (e,g.^ an unmatched parenthesis) 

(b) - semantic errors which derive from invalid 

combinations of operations 

(c) logical errors which produce incorrect results but do 
not cause maliunction of the program 

(d) clerical errors due to oversight or carelessness such 
as mispunched cards, missing cards, exceeding 
page/line limits^ etc* 



Iji APL, syntactic, seaantic, and nost clerical errors occur 

as one of three different types: 

(A) iffinediate execution errors vhich produce one of the 
eight expixcxt error Messages: SIMTAX, ?^ALU£,^ IHDBX, 
KANK, LMGTH, DOHAIN, DBFK, or EKT&I ERROR, as well 
as an indication of tiieir location in the expression. 
For exaiiple: 

(A-B+C 
SYNTAX ERROR 

(2) errors during the execution of u defined function. 
These errors produce an explicit error message as in 
(1) an^i also suspend execution of the function at the 
line in which the error was detected. For exaftple: 

SINTAX ERROR 

DEHOn ] CA-"B^C 

<3) errors in the use of systeA coinands or variables. 
These errors are concerned with Kanipulating 
workspaces, functions or trariables or resource 
allocation. The explicit; error messages are: 
liiCORRECT COHKAHD 
WS/OBJECT MOT FOUliD 
MOT SAVED : 
SYHBOL TABLl/IIS FOLL 
S¥ IMPLICIT BBROk 
The^^XSrtrt for« of these error aessages differs 
l>etveen versions of APL and ijQstaliai|4ohs (i-e., 
these are the aost system dependent messages) . 
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It is interesting that a Xangoage with a relatively 
large nunber of defined priftitives has a relat'^lYel; saall 
husber of error messages. Uonever, the six messages,; VALO£, 
RAMKr DUNAIM, LENGTH, IHDBZ, ana 0£fli Cover the basic 
seaantic » error^s possible. A major reason for this is thelir 
generality across the sajor d%ta types (i.e., scalars, 
vectors, and aa trices) ^as well^ as* across constants rji^^ 
literals. Thus iihile errors due to invalid data types are 
possible in other languages (e-S* OECLABE or BEAL 
statements), they are not in APL because of the dynaaic 
allocation of variable types. Since APL has no special 
stateaents^ for subroutine calls, errors of this type cannot 
-arise. If a subroutine is given incorrect arguments (the 
equivalent of an incorrect-tparaaeter lis.tK,. a_ WLJJE error 
vould^ occur. Other errors such a bad branch (e.g., to a 
aissing label) or failure to initialize a loop counter vill 
also result in. VALUE errors. 

Because' of this generality, aultiple causality of error 
'aessages xs coai\on in APL. Figure 1 illustrates this 
problem. In Figure la, a student defined a abnadic function 
A with the arguaent FIB (which does not appear in the 
function. Upon executing A, a SYMTAX error was produced 
since the occurrence of A in line 1 lacks an arguaent. The 
student then tries executing the arguaent of the function 
but again receives a SIITAX error, this time because there 
is ao function relating the two constants. Although the saae 
error aessage was generated, the nature ^of the errors are 
different. Furthermore, this error message does not reveal 



the real probleMi, na&eiy that the student doesn*t understand 
Jtuhction headers. Figure 1(b) shows another example with 
system comatands# Both of these * errors are exaiiples of 
clerical errors although they generate different error 
aessages* 

Ai^L Error Fjceguencies 

Data on error frequencies in APt was obtained by 
analiziug listings of 148 complete and partial APL sessions 
collected xroai student terminal rooms at the Oniversity of 
Alberta These listings included the work of both novice 
and experienced programmers and a variety of applications 
areas. The mean duration of t^hese sessions was 31 .4 minutes 

{sMaxiisum: 246.6 minutes, minimum: i.^i minutes). The mean CPD 

\ 
\ 

txtte per sessxon was 2 16, seconds (maximum: 52,2 seconds, 
rtiiniJLum: 0»1 second). There was an average of d«36 
errors/session. 

Table 1 presents che frequencies of errors for the 
^variousL^-eJcror .m^essagesa First of all, it can be seen that 
the B inoediate execution! errors accounted for over 90% of ^ 
all error messages while workspace error messages (due to 
system, commands) accoun.ted^or^.less^.than ^9%_^.of_ ^the. total, 
i^ithin the first category, ?AI.UE and SYNTAX error messages 
account ior ovex: half of the massages* DBPN and SNTBY error 
messau^^i;; were also relatively common. DOHAIN, LBMGTH, BAlIK, 

V 

- - — I 

2 . The version of APL^.was APLTS running oa an AHDAHL T6 
under the ATS operating system • 
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aiid INDEX error aessages occurred relatively infreguently. 
As far as the workspace error •essage« are concerned, 
18C0RSBCT COttWAsD accounts for about halt o£ these errors 
with vs HOT P0U8D accounting for about 25% of the total. 
There were no instances ot system variable error messages in 
the Saibple. 

Many instances of so»e error Bessages were due to the 
^.sa»tf— error. -For- exa«pie> a large percentage of DEfN errors 
have to do with tlie closing sguare bracket of the function 
line nuaber. It is co««only onitted or a round bracket ased 
Dv Mistake (this being the saae key shifted) . The Ba jority 
ot iNCOHftiiCT COBHAMD errors are due spelling or spacing 
errors and aost MS NOT FOOMD errors appear to occur due to a 
forgotten wc rksj^-ace naae (MS MOT FOUNDS errors are typically ' 
followed by ) LIB) . A large percentage of DOilAiH errors are 
attempts to divide by 0. On the other hand, ¥ALOB and SYNTAX 
errors arise fro» a number of different problems and this 
probaDly accounts to some extent for their popularity. 

The failure to assign values to variables (which result 
in VALOB errorrs) and unmatched parenthesis (STMIAX error) 
were two common problems. /Jany errors were due to 
misunderstandings about the header in defined functions. 
These misunderstandings included (i) the unneccesary 
duplication of the function name in the first line or 
^ function (sometimes resulting in unexpected 

recursion) , (ii) the use of different variable names in the 
i*oay of the function than those used in the header, (iii) 
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putting tfio aigufteucs in the ncong position in the header ' 
producing a function with an unexpected nave (see Figure 
Id), (iv) the redundant use of guad tor input when the 
ri:nction arguments already assigned values to those 
variables, (v) th^ ouput of function results when they were 
autoRatically proauced due to the explicit result fori of 
the header. These «iisconceptions can result in almost any oi 
the explicit error messages* adthougb typically they produce 
either a YALU£ or SYNTAX error. 

A nuaber of debugging strategies were observed in the 
analyiiis of the data. The most coMon strategy was the 
systematic decoa position of expressions, i.e*, testing each 
sot of operations worl^ing from right to left. Another com&ou 
technique in debugging defined functions was to rebuild new 
i unctions using wording parts of earlier functions. Various 
types of ••retry" behavior were observed tjuite frequently. 
The sicst cojciaon one was simply to retype exactly the 
expression which producea the error to see if it generates 
the error again. Another "retry** behavior was to )CLBAK or 
* sxgn-off and then start over again. This later approa.ch was 

comiaun ior novice programmers. 



Conclusions 

The data presented in the preceeding section is guite 
iieited in what it rev>>als anout errors in APL# It provides 

caused, 

say in terns of particular operations or algorithas* flare 



no detailed information on how each error type was 
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iiiportantly r this data does act include logic errors (nhich 
ijeneraliy uo aot produce error ftessaijes) • Because the 
characteristics ot the uio^x^aiimers iias not known (i«e«, 
cheir experience) nor the nature of the prograaiing problea, 
the exfeats oi these variables is not jcnonn. Finally, it 
IxJc^l/ that the errors generated in a student ^ucograMing 
environment would differ from a coMercial or prodnction 
environi2iei;t« 

The data aoes indicate that assignment errors (which 
woeid generate VALUE errors) are probably the Bost cobaou 
type of error iiade in AtL in other languages. It also 
ai»pears that syntactic and semantic errors are about egually 
frequent in APL* ihe data also reveals that DE^M errors are 
ffluch wore coititon than one would expect while BAMKr ©OHAIHr 
LSNGTH^ and IHDEX errort> are less coaaon than anticipated,, 
although the present data does not fir«ly establish this 
conclusion. It soeits possible that the syntactic coiplexity 
of A PL expressions leaus to aore syntactic errors than in 
other languages In so far as subscripting is a frequent 
operation in APL^ it is interesting that IKDEX errors are 
not aore coaiaon (although errors in subscripting could 
generate rank or length errors) . The fiisunderstandlngs 
associated with the function header in defined functions 
sceas a unique problea of APL without an exact parallel in 
other languages perhaps sugg^^ting a need for language 
design changes. 

As Weil as contributing to a better understanding of 

u 
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the progrdfc^iug process and^ the desigg of ^*POteF 
iaQgua9es, iDi:oraatio& <ibout prograiimiug has tvo aajbr" 
practical uses. The iirst use is in the teaching of the 
prograttming language. For laxaiiple, Che present data on APL 
errors, suyue«ts that increased attention should be given to 
the presentation ol. assignaent and the fora of function 
arguiteacs. The seconu use is in the coding and debugging ol: 
APL prograiis>« Given a kuovledge of the fpst likelf errors^ 
increased etfort can be nade during the coding and checking 
OL proi/raas to prevent these problems. While at soae point 
in the future we aay hare automatic correction of errors and 
prograii proving, ut the present tine, both of these uses of 
IniorAdtion on progra&oiing errors is of sote iaportance. 
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VRtA FIB 
111 S^B/A 
[2j V 



A 0 

sijiTAi samR 

4C13 M/A 



PIB 0 
SYSTAX ERROR 
PIB 0 

.A 



j Figure la. An example of the sane error for different reasons. 



• .)LOADWS. 
WS HOT FOUND 

)L0ADW31 
INCORRECT COtmND 

)L0AD WS 
SAVED 10:52:30 01"/01/78 



Figure lb. An example of tha same error pfbducingVdiffefent 
error nessages. . , , • „ _ 
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Table -1* 

kPL error frequencies. 

Tutdl Errors Percentage 



•function £xecutioQ ■ 1131 91.8 

i»aLOE 317 25 i6 

sifHTAX. 314 • 25.4 

D&BrH. 217 17:. 5 

KMIKX 137 11 ii 

■m&iiw i .50' :uvo 

LiiSGia 34 ^ 2.7 

Rhilk 34 ■ 2.7 

— - - liJ DM 2ii ^^--^-^-^-.2'-6r-- 

Kcricspace aanageitent 106 8.2 

xMCORBiiCT boBRANO 52 4.2 

•lis SOT^FOOKD ' _2,6 2.1, 

-HOai-siVEi)- ^9 — 0 .7— 

SOT FOUND 7 0.5 

WS Flll.ii. 5 0.4 

STACH FULL 3 0.2 

NOT COPIED 2 0.1 

SXHbOL TABLE KULL 2 0.1 




APPEHDIX . - 

i: 

This report is part of a study p£ APL progranBing 
intended .to .provide . the f ouhdatldh- for-a ;ooBpji^ APL^ 
piobleft soivina laix>ratory» Soch a laboratory irou Id permit 
the student to " ffifxte dHid deW^J ^ TA'PL^^^^^ uffder^^tl^^^^ 
control of a powerful APL tutorial systeii* Th^ Stanford 
Basic iostructional Program (BOP) system provides one iodel 
of ho If ^uch a sy^teft can i>e desigiied and iitiat capabilities 
c a ni:ir^px o vid €d V 

(a) a iohitored BASIC iuterpetef wriTten:™'!^^^ SKich 
allows rhe instructional, systep, complete intbraation 
about student erxTofs - ^ .-.^ 

(b) 4 Curricttlu» inforttaticn Metvork (CIN) which 
describes a large nufib^r o£ pro^aitting proMeis in 
terns ot the basic skill^ i&yol>€^^ Probleps 
for. SQiatiqn; :are:.selected.,£roa. CI^ using: a. .iiodel 61 
the scudeht *s previously adquir^^^ 

(c) a hint/help syst^ii iihicli gives grapExc and textual 
aid durixig problem solving. 



Another approach £s*TKe PljfflO wFici is a. 

table-driven diagnostic coftpiitfc/interpreter, CAPS resepbles 
Batch diagnostic compilers (such as Pl/C) except that 
instead of trying to recover frpa detected errors/ It 
reports errors and attempts to help the student repair then 
rnteractriy6Iy^because*-eAPS-^s™trabl — possi*ble 

to have PAPS vofks for all language for vhicE tables exist. 
At present tables exist for PpUTBAlir PL/-1r- an^^^ The 
CAPS system consists of an edit-time and rnn^tiie er^^ 
aiializer., ah editor, a file maiiager^ and the ertor table ahd 
interpreter fot e^ch language^ It also f eatutes a "'cdiimon 
fflisconceptionr table" vh5.ch contains information about thie 
language which is a potential trouble spot and templates tor 
the ht^lp to be provided if that problem; ariises. 

-Irregardless of which approach is used in the design of 
a' prooleii solving labprary, a considerable aik>ttht of 
detailed information about programming eri^ois rh the^^t^ 
±angudge/must be icnown'. In the present case^r thi^^^ meahs^ a 
rtfasonably complete list of the of the sJci^Lts inyoli^ed in 
loarninc APL. Table 2 provides sfuch a liBt* Thijs kit^ list 
provides a basis for the APt jorpgra^^ 

develppea and the concepts/procedures to Be taught. It also 
forms the basis for the derivation of a set of errors which 
could arise in learning or perfprming these APL ski US. this 
set of error rul>is will be the next step in tbe development 
ot an aj;l prpgramming labpratory. 
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Table 2 
Skills in APL 



simple Operations 
t)§e drilliietic priiitxres aloue (scalars) 
:Uiie. arithaetic^priaitives. im copbinations (scalars) 

_ Oi3» arithiiitttic primitives alone (yectoxrs) 

Ose aritheat:ic primitives in combinations (scalars) 

Sirfi.>jLe Aiisigaent (scalars and vectors) 
Ksi:>l}^u numej^c scalars: to variables 
Display numeric scalars 
Heassi^h, inpmei^ic -scaiar s 
Assign numeric vectors to variables 
Display numeric vectors 
Ke assign numeric vectors 

Assign literal strings (vectors) to . variables 

aisplay literal strings " 
Heassign lit^r^l strings 

Simple Inde:xing (Vectors) 

.^Dispia^y-a-l-l-elements^-ol— V — — - — 

iiapliice (reassign) selected' elements of vector 

/lore Cowplxcated Assignmen't and Indexing 
Assign numeric: values to matrices 

Pis pla y num eric^vaines ^in^maiiriQ>s „„ _ _ ^ 

Kepxace -nuweric values in matrices 
Assign literal values in matrices 
lji;iplcty literal values in matrices 
Replace literal values in matrices 

ftpre Complicated Operations. 
Hui!:eri c 

Find m in/max 

Find iloor/ceiling 

Pina powers/square roots 

Find absolute Value/residue 

find combinations/factorials 
_jC5.enerate_random, number^^^ 

Sort, in ascending/descending order 
. Selection 

Select using -membersnip/iadex 

Select using grade up/grade dovn 

Select using take/drop 

Select .using co*press/exj[>and 
Restructuring 

Restructure using reshape 

Restructure using catesiate 

Restructure using laminate. 

Restructure using transpose 

Restructure using rotate 

Restructure using reverse 



Coapare numeric arrays Qslnti eqaalitias/inegoalities 
Coaipare literal artays using eqaalities/lnegualities 
Cospare. nuperic arrays, using logical relations 
Coipare literal arrays usiiig logical relations 

"^Transratior—™^ ^ 

translate number bases using encode/dec(>de 
Translate data structures using execute/foraat 

Alyorithftis ^ * 

Alter execution order using parentheses a 
Rewrite expressions to rettuwe parentheses*^ 
Vrite algorithn to coiipute peans 
Mrite aigorithn to do srrts 
Write algorithas to produce graphs 
Write algoriths to do text editing 
Write algo;?!^ for statistipal functions 

Defiifed Functions , 
Function pefinitioii 

Crea te and execute niladic function 

Creat'e'anff'^exec^ without iifplicit 1d5su1 t 

Create and execute atonadic function with explicit result 
Create and execute dyadic fttuction without explicit result 
Create and execute dyadic function with explicit result 
Display & kditing 

— ^Dispiay-en tire-f unction — ~ — — — — - 

Display selected I'inei^ 
Hodity lines and display 
Delete lines and display 
Insert lines and display 
Add lines and display 
Branching 

Use slash for unconditional branch to line number 

■* Ose^siasrhr^for^cdndl^t^^ branch to line, nuaber 
Dse slash for conditional branch to label- 
Use arrow for conditional branch to labels. 

Use n-way conditional' bfanch 
Use jcoaputed branch to line nuiber 
Iteration — — ^ z^.^^ . ^ . ^ — . ^ — 

Build single loop using line nunbers - 
Build single loop using labels 
Build nested loops 
Denonstrate recursion H 

LliDinate branching via structured prograaaing 
Input/Output 

Use guad lor input 
Oise quad for output 
Use gubte^^guad for input 
Use guote'^uad for ouput 



Ho rics paces 

Save vorJc^pace ^ 
Load vorkspace 

Copy variables, functions £ro& itofkspace 
Copy variables^ functions trok public iibrar 

Xiedn workspace 

Drop workspace 

Reiiaae vorkspace using WSID ^ 
Use Lib, WAfiSr FNS 
Change printing precision 
Change page width 
Change index origin 
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